Implications of Form Invariance to the 
Structure of Nonextensive Entropies 



A. K. Rajagopal^ and Sumiyoshi Abe^ 



^ Naval Research Laboratory , Washington, DC 20375-5320, USA 
^College of Science and Technology, Nihon University, 
Funabashi, Chiba 274-8501, Japan 



The form invariance of the statement of the maximum entropy principle and the 
metric structure in quantum density matrix theory, when generalized to nonextensive 
situations, is shown here to determine the structure of the nonextensive entropies. This 
limits the range of the nonextensivity parameter q to (0, 1) so as to preserve the 
concavity of the entropies. The Tsallis entropy is thereby found to be appropriately 
renormalized. 
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Nonextensive generalization of Boltzmann-Gibbs statistical mechanics is found to be 
essential for a cogent description of a large number of observed phenomena involving 
(multi)fractal structures, long-range interactions, and long-time memories, which are 



increasingly of general interest in many facets of physical sciences. In particular, the 
form of the generalization originally proposed by Tsallis [1] has been widely used to 
analyze many such systems, phenomena, and theories. Examples are Levy-type random 
walks and anomalous diffusion [2], hydrogen- atom specific heat [3], pure-electron 
plasma [4], stellar polytropes [5], mean-field magnetization [6], velocity distribution of 
clusters of galaxies [7], interpolative quantum statistics [8], and generalized theory of 
thermal Green's functions [9]. (A comprehensive list of references to the literature on 
this subject is currently available at URL [10].) However, some ambiguities in the early 
proposal have remained and attempts have been made to rectify them by introducing 
appropriate definitions of generalized expectation values in order to be in conformity 
with the conventional properties of statistical principles [11]. These modifications have 
been more or less ad hoc, thus inviting investigations of guiding principles which would 
lead to a clear basis for any proposed forms for the generalizations of Boltzmann-Gibbs 
statistical mechanics. 

In this paper, it is suggested that the idea of the relative entropy as propounded by 
KuUback and Leibler [12] can provide such a guiding principle for determining 
unambiguously the structure of the nonextensive entropies. This is because the 
KuUback-Leibler (KL) entropy gives a measure of uncertainty in the objective state p 
with respect to the reference state p' : 

K\p, p'] = Tr[p(lnp'-' - Inp"')] > 0, (1) 

where p and p' are normalized density matrices. The equality holds if and only if 
p = p'. Therefore ^j[p, p'] quantifies the difference between p and p' . It is a 
physically measurable quantity unlike the entropy itself and serves to affirm the nature 
of maximum entropy principle [13] as well as an underlying geometric structure [14]. 
We will discuss here a similarly defined relative entropy for the nonextensive systems 
along with the appropriate definition of the normalized ^-expectation values. The 
central result of this analysis is that the original Tsallis entropy should be properly 
modified in order to establish the form invariance by presenting the generalizations of 
the above two properties. The KL entropy in eq. (1) and the von Neumann entropy in 
eq. (2) below are presented in these particular ways in anticipation of the form 
invariance that we are seeking when they are generalized. Unlike the original Tsallis 
entropy, this modified form is found to be concave only if the nonextensivity parameter 
q lies in the interval (0, 1), into which all of the nonextensive Hamiltonian systems 
seem to fall [15]. 

We begin by deriving the above-mentioned two properties in the Boltzmann-Gibbs 
context so as to provide us with the guiding equations, with which the results of our 
generalization should conform. We do this in the quantum-mechanical context by 
maximizing the von Neumann entropy 



5.[p] = Tr(plnp-^) 



(2) 



subject to the constraints of the expectation value of the energy ?7j = Tr^p^j 

(where H is the Hamiltonian operator of the system under consideration) and the 
normalization of the density matrix. Throughout this paper, we use units with the 
Boltzmann constant kg set equal to unity. The resulting density matrix is found to be 

p' = exp^-^^^- i/j^l^Z, Here, f5 is the Lagrange multiplier associated with the 

energy constraint which is identified with the inverse temperature, and Zj(jS) = 

Trexp^-jS^H- ?7ijj is equivalent to the standard partition function. Using this in eq. 

(1), we have the following maximum entropy relation: 

k\p,p'] = SXp']-S\p] + I5{h-U,)^ >0. (3) 



This is the first of the equations, the form of which we wish to preserve in our 
nonextensive generalization. 

On the other hand, suppose the density matrices be characterized by a parameter a . 
(Extension to the case of multiparameter is straightforward.) Since p{oc) is a Hermitian, 
positive semi-definite, traceclass operator, it can be expanded in terms of its 
orthonormal eigenbasis || a(a))} as follows: 



P(«) = 21 Pa («) I a{a)){a{a) \ . (4) 



The expansion coefficients are usually interpreted as the probabilities of finding the 
system in the eigenbasis states {|a(a))} and therefore satisfy the relations 



Q<pSa)<h 21p,(a) = l. (5) 



Taking p' = p{a) and p = p{a + da) (where da is an infinitesimal change of a) in 
eq. (1), up to the second order in da , we find the following metric: 

ds' = K,[p, p'] + K,[p', p] = d4 + dsl, (6) 

^4 = (./a)Xl^^^ = 4(rfa)^((Klnp--(a)f ))^, (7) 



dsl=2{dafY, \{a\a)\d,\a{a))^pSa)[lnp;! (a)- In p:\a)] 

a, a' 

= 2{dafll^ |(a'(a)|4|a(«)>f [lnp;Ha)-lnp;H«)]^^ , (8) 

where the double bracket symbol stands for the ordinary expectation value with respect 
to p^oc) . This is the second of the equations, the form of which we wish to preserve in 
our nonextensive generalization. We note that equation (7) does not contain the overlap 
between basis vectors, resembling the classical Fisher metric (i.e., the KL divergence) 
even though it has quantum probabilities, whereas equation (8) is explicitly quantum in 
nature by virtue of the presence of the overlap. The latter quantity is seen to be positive, 
implying the quantum contribution expands the scale of length as it should do. To the 
best of our knowledge, this observation has not been previously made in the literature. 

The structures exhibited in eqs. (3) and (6) will be the two chosen forms which any 
generalization of 5'j[p] to a nonextensive entropy is required to satisfy. Thus our 

proposal of a guiding principle is to maintain the "form invariance" of these equations 
in such a generalization. 

The following form of the generalized KL or q-KL entropy 

K':\P, P'] = Tr [p«(Ln^ p'"' - Ln^ p-^)]/Tr (p*) > (9) 
and the modified form of the Tsallis entropy 

S';'[p] = Tr(p^Ln^p-')/Tr(p^), (10) 

where 

Ln^^ = (^^-'-l)/(^-l), (11) 

will be shown to lead to form invariant structures in the sense defined above. In the 
limit ^ — > 1-, equations (9), (10), and the definition of hn^x become eqs. (1), (2), and 

the standard logarithm, Inx, respectively. Expressions (9) and (10) correspond to those 
given in Refs. [16,17] and [1] divided by Tr(p') = c^(p), respectively. Although the 
inequality in eq. (9) holds for any positive q, the entropy (10) is seen to be concave for 
q only in the interval (0,1). The modified expressions (9) and (10) satisfy the H- 
theorem as the original ones do [17]. However, the additivity property of 5'^''^[p] is 



changed to 



ST[Pa ® Ps] = S["\h] + S^:\Pb\ + 1) ^ ^[Pj^r'[p.]- (12) 

It is of interest to note that this relation has the same structure of the Jackson basic 
number of A defined by [A]^^ = {^q'^ -iy{q -1) in (^-deformation theory. The basic 
number of A + 5 satisfies the identity: [A + 5]^ = [Mq +[^]^ + ~ which 
has a striking similarity to eq. (12). To understand this similarity better, we consider a 
quantity f(x) = 1 /Tr(p"). Clearly, /(I) = 1. The von Neumann entropy is expressed as 
the rate of infinitesimal translation of the index x from x = 1 : S^^p^ = df(x)/dx \ On 
the other hand, the modified Tsallis entropy is found to be given by the Jackson q- 
differential: S';'[p] = DJ(x)\^^^^[f{qx)-f{x)]/{qx-x)\^^^. Convergence of 5<">[p] 

on ^^[p] in the limit ^ — > 1 is due to the fact that the Jackson ^-differential becomes the 
ordinary differential in such a limit. Equation (11) is a result arising from the q- 
deformed Leibniz rule which the Jackson differential satisfies: D^[f(x)g(x)] = 

^D^f(x)^g(qx) + f(x)^D^g(x)y These properties are similar to those noted in the case 

of the original Tsallis entropy [18]. A physical interpretation of this observation is that 
the system entropy has the scale invariance with respect to the nonextensive parameter 
q. 

We choose p' to be the one which maximizes the 5*°' subject to the constraints of 
the normalized ^7-expectation value of the energy = Tr^p'' jc^^ (p) ={h^ and the 
normalization of the density matrix. The resulting density matrix is found to be 



P = 



\-{\-q)fic\H-u)/\ , (13) 



Z^iP) = Tr [l - (1 - q)Pc^(H - U^)]"'"", (14) 



where the Lagrange multiplier associated with the constraint on the ^-expectation 
value of the energy defined above is identified with the inverse temperature. The 
generalized partition function Z^()S) and the factor satisfy the identity: 

= [z^(;S)j^~*. Using eq. (13) in eq. (9), we have the following maximum entropy 
relation: 



K^p' p'] = KV] - KV] + ^(^ - ^.), ^ • 



(15) 



Thus, we see that equation (15) maintains the same form as eq. (3). 

Now, taking p' = p{a) and p = p(a + da) in eq. (9) and carrying out the calculation 
as before up to the second order in da , we find the following generalized metric: 

< = K^ip, P'] + [P'' P] = Kci + dsl^, (16) 



=T^I^ |(a'(a)|<9>(a))|V:(«)Kp;H«)-Ln^Pr(«)] 

/ .Pn \^) a, a' 
a 

= 2{daf[ly |(aV)|4|«(«))rKp:-(«)-Ln^P:'(«)])) ' (18) 



where the double bracket is now defined by ((^A^{Pa))) =^ Pl'^aiPa)/^ pI - Thus, 

we again see that equation (16) maintains the same form as eq. (6). 

We have therefore established the two form invariances of the generalization 
promised in the beginning of the paper. 

In conclusion, the form invariance requirement has led us to the modifications of the 
^-KL entropy and the original Tsallis entropy as in eqs. (9) and (10). Had we used the 
original forms of these quantities (i.e., without division by c^), the form invariances 
would not be established. 
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